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Abstract 

Background: The fatigue that users suffer when using steady-state visual evol<ed 
potential (SSVEP)-based brain-computer interfaces (BCIs) can cause a number of serious 
problems such as signal quality degradation and system performance deterioration, users' 
discomfort and even risk of photosensitive epileptic seizures, posing heavy restrictions on 
the applications of SSVEP-based BCIs. Towards alleviating the fatigue, a fundamental step 
is to measure and evaluate it but most existing works adopt self-reported questionnaire 
methods which are subjective, offline and memory dependent. This paper proposes an 
objective and real-time approach based on electroencephalography (EEG) spectral 
analysis to evaluate the fatigue in SSVEP-based BCIs. 

Methods: How the EEG indices (amplitudes in 6, 9, a and (3 frequency bands), 
the selected ratio indices (9/a and (9 + a)/p), and SSVEP properties (amplitude 
and signal-to-noise ratio (SNR)) changes with the increasing fatigue level are 
investigated through two elaborate SSVEP-based BCI experiments, one validates 
mainly the effectiveness and another considers more practical situations. Meanwhile, a 
self-reported fatigue questionnaire is used to provide a subjective reference. ANOVA is 
employed to test the significance of the difference between the alert state and the 
fatigue state for each index. 

Results: Consistent results are obtained in two experiments: the significant increases in 
a and (9 + a)/(3, as well as the decrease in 9/a are found associated with the increasing 
fatigue level, indicating that EEG spectral analysis can provide robust objective 
evaluation of the fatigue in SSVEP-based BCIs. Moreover, the results show that the 
amplitude and SNR of the elicited SSVEP are significantly affected by users' fatigue. 

Conclusions: The experiment results demonstrate the feasibility and effectiveness of 
the proposed method as an objective and real-time evaluation of the fatigue in 
SSVEP-based BCIs. This method would be helpful in understanding the fatigue problem 
and optimizing the system design to alleviate the fatigue in SSVEP-based BCIs. 

Keywords: Fatigue, Objective evaluation. Brain-computer interfaces. Steady-state visual 
evoked potential. Electroencephalography spectral analysis 
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Background 

Brain-computer interfaces (BCIs) provide a direct communication pathway connecting 
human brain and external devices that is independent to normal peripheral nervous 
and muscular systems. BCIs measure the brain activities and translate the encoded hu- 
man intentions to control computers, wheelchairs and robots, with a wide range of ap- 
plications [1]. Among the non-invasive BCIs, steady-state visual evoked potential 
(SSVEP)-based BCIs have attracted much attention owing to their merits such as high 
information transfer rate (ITR), small number of electrodes and short training time in 
comparison with other types of BCIs [2]. 

On the other hand, most SSVEP-based BCIs remain in the laboratory demonstration 
stage, with a big gap from practical use by paralyzed patients or normal users for a long 
period. One of the challenges is the fatigue that users suffer when using SSVEP-based 
BCIs. In laboratory demonstrations, the experiment is usually short, e.g., few seconds 
for one trial or few minutes for one experiment. For a longer period under normal use, 
when staring at the flashing stimulus however most users have uncomfortable and un- 
pleasant feelings including tiredness, drowsiness, loss of attention and difficulty in con- 
centration, which are the symptoms of fatigue. 

Fatigue is generally referred as a feeling of tiredness, reduced alertness, exhaustion, 
which impairs both capability and willing to perform a task [3-5]. An ideal BCI should 
be easy to perform with little effort to prevent fatigue but strong electroencephalog- 
raphy (EEC) signals to produce reliable and effective output [6]. Unfortunately, in 
SSVEP-based BCIs significant mental effort is required for the users to concentrate on 
the visual stimulus to generate sufficiently strong SSVEP, however due to high bright- 
ness, overstimulation and repetitive task, users may easily get fatigue [7]. As attention 
dependent systems, SSVEP-based BCIs require target gazing and therefore the ampli- 
tude and signal to noise ratio (SNR) of the elicited SSVEPs are heavily affected by men- 
tal states, fatigue, arousal and degree of attention level [8-10]. Loss of attention and 
decreased arousal level caused by mental fatigue or distraction can significantly worsen 
the SSVEP signal quality [11] and consequently degrade the BCI system performance. 

In the literature of SSVEP-based BCIs, fatigue and its influence in long-term experi- 
ments have been already noticed [12,13], however so far there is no systematic study 
on the fatigue problems. A frequently used strategy to reduce fatigue is to adopt some 
relatively comfortable stimulations, such as high frequency stimulation [14,15], high 
duty cycle stimulation [16] and amplitude modulated stimulation [17]. Unfortunately, 
the crux of the matter is that there is no objective method to measure and evaluate the 
fatigue in a reasonable manner. In the existing work, a common choice to "measure" 
fatigue is self-reported questionnaires provided to the users for feedback about the feel- 
ings of fatigue in operating the systems [15,18-20], which are subjective and cannot be 
done in real time. 

When users feel fatigue, they usually have excessive feeling of tiredness and reduced 
alertness, and also have difficulty in concentrating their attention on the task to per- 
form [4,21]. In the case of decreased attention, arousal level and the reduced capacity 
to perform the task, the complex synchronization-desynchronization patterns in the 
4-13 Hz band can be assumed disrupted [5,22], which are associated with reduced cor- 
tical arousal (i.e. EEG shifts from high frequency and low amplitude waves to low fre- 
quency and high amplitude ones) [22,23]. More specifically, the decreased attention 



Cao et al. BioMedical Engineering OnLine 2014, 13:28 
http://www.biomedical-engineering-online.eom/content/13/1/28 



Page 3 of 1 3 



and arousal level, as well as the reduced capacity are associated with the global in- 
creases in the 6 and a activities [22,23]. The 9 activity occurs in a variety of mental 
states including drowsiness, and the increase in 6 activity is related to generalized per- 
formance decrements on task [22]. The a waves appear during relaxed conditions, at 
decreased attention levels and in a drowsy but wakeful state [22,24], and the increased 
a power associated with fatigue is related to the increased mental effort to maintain 
vigilance level [22]. Since the EEG reflects the mental state and fatigue of the users, 
EEG spectral analysis could be a promising method to provide an objective and real- 
time evaluation of the fatigue level in SSVEP-based BCIs. 

Our preliminary study [25] shows that the increased 6, a, and (9 -i- a)/|3 power are as- 
sociated with the increased fatigue level, and the SSVEP amplitude and SNR are influ- 
enced by fatigue level. On this basis, this paper further checks the feasibility and 
effectiveness of proposed objective method for fatigue measure and evaluation in 
SSVEP-based BCIs through two elaborate SSVEP-based BCI experiments, one validates 
mainly the effectiveness and one considers more practical situations. The changes of 
EEG indices (6, 9, a and (3), ratio indices (9/a and (9 + a)/|3), and SSVEP properties 
(amplitude and SNR) associated with increasing fatigue level are investigated. The pro- 
posed method would be helpful in understanding the fatigue problem from the view- 
point of EEG spectrum. With appropriate methods for measure and evaluation, a 
systematic study on the influence due to different configurations (such as different 
stimulus frequencies, colors and patterns) can be performed, and eventually the design 
of the system including the visual stimulator can be optimized in order to alleviate the 
fatigue in SSVEP-based BCIs. 

Methods 

Experiment design 

In order to prove the feasibility and effectiveness of the proposed method, two elabor- 
ate SSVEP-based BCI experiments were designed and two different groups of partici- 
pants were tested in this study. More specifically, in Experiment 1 a single stimulus 
was used to elicit SSVEP at the selected frequency and the purpose was to prove that 
the EEG spectral analysis is effective in measuring the fatigue in SSVEP-based BCIs; Ex- 
periment 2 employed several stimuli encoded by different frequencies for the purpose 
to show the feasibility of the proposed method in practical situation, because in a real 
SSVEP-based BCI, normally there must be a number of buttons for different com- 
mands presented by different stimuli with different frequencies, rather than only one 
stimulus as in Experiment 1. 

Twenty-one randomly selected university students (aged from 21 to 29 years old) partic- 
ipated in this study. The participants were selected according to the following criteria: no 
history of psychiatric or neurological disorders, no psychotropic medications or addiction 
drugs and with normal or corrected to normal vision. Informed written consent was ob- 
tained from all participants after explaining the nature, possible consequences and privacy 
issues of the study to them. The protocol was in accordance with the Declaration of 
Helsinki and approved by the Research Ethics Committee (University of Macau). 

An LCD monitor was used as the visual stimulator (ViewSonic 22", refresh rate 120 Hz, 
1680x1050 pixel resolution), which was programmed with Microsoft Visual Studio 2010 
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and Microsoft DirectX SDK (June 2010). White stimuli with 120x120 pixels on black back- 
ground were used for best contrast in this study. There was a symbol "+" shown in the cen- 
ter of the stimulus before and within each trial, indicating the stimulus that the participants 
should gaze at and keeping the participants focusing on the target, so the participants could 
follow the cues to gaze at different stimuli. The experiment facilities were set in a normal of- 
fice environment without intensive light and noise, and participants were seated on a com- 
fortable chair in front of the visual stimulator with a distance of about 50 cm. Since the 
participants were told to keep the body unmoved and not to blink eyes in each trial, the ar- 
tifacts and other noises were controlled to the minimum. All the experiments were con- 
ducted in a frxed time period (3-4 p.m.), and all the participants finished the experiments 
successfully without suffering any unpleasant feeling and discomfort in bodies. 

EEC measurement 

A standard EEG electrode placed on Oz, in the international 10-20 montage system, 
which was located in the center of the occipital lobe, was used as the input channel. The 
reference electrode and ground electrode were chosen as FCz and Cz, respectively. EEG 
signals were amplified through an amplifier (g.USBamp, Guger Technologies, Graz, 
Austria) and filtered by a 50 Hz notch filter and a 0.5 Hz to 60 Hz band-pass filter to re- 
move the noise. The sampling frequency was 600 Hz. The frequency bands 6 (1-4 Hz), 9 
(4-8 Hz), a (8-13 Hz), and p (13-30 Hz) were monitored along the experiments. 

Psychological measurement 

All the participants were asked to finish a self-reported fatigue questionnaire before and 
after the task, which was based on the Chalder Fatigue Scale (CPS) [26]. The CPS had high 
reliability and validity and consisted of 8 physical fatigue questions and 6 mental fatigue 
questions, such as "Do you have problems with tiredness?", "Do you need to rest more?" 
and "Do you feel sleepy or drowsy?" Besides, another 6 questions related to visual fatigue 
symptoms were added in this questionnaire. These six questions were: "Do you have eye- 
strain?" "Do you have eye dryness?" "Do you have headache?" "Do you feel fatigue in 
eyes?" "Do you feel blurry?" and "Do you have difficulties keeping eyes open?" Therefore, 
there were 20 questions in total and every question had four choices rated as a four-point 
scale (0-3), i.e. better than usual (0), no more than usual (1), worse than usual (2) and 
much worse than usual (3). A high fatigue score presented a high level of fatigue, and in 
this study the questionnaire was used to provide a subjective reference to evaluate users' 
fatigue level before and after experiments. 

Experiment procedure 

In the first SSVEP-based BCI experiment, only one stimulus flashing at 15 Hz was used 
to elicit SSVEP. Eight participants participated in this experiment and were asked to 
gaze at the flashing stimulus for 30 trials. The stimulus was flashing for 3 seconds in 
each trial with a 2-second pause for a short rest between two consecutive trials. 

The paradigm of the second experiment employed several stimuli encoded by differ- 
ent frequencies and thus simulated a more general and practical situation. There were 
six stimuli distributed in two rows and three columns in this experiment. Thirteen par- 
ticipants participated in this experiment and they were asked to gaze from the stimulus 
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1 to the stimulus 6, and repeated for 6 times (i.e. 36 trials in total). To test on the com- 
monly used stimulus frequencies, two sessions were performed, with the stimulation 
frequencies in 7-12 Hz for Session I and 13-18 Hz for Session II. The stimuli were 
flashing for 8 seconds in each trial with a 4-second pause between two consecutive tri- 
als. Every participant did the experiment for both two sessions and a 5-minute pause 
was given between the sessions to reduce the fatigue caused by the previous one. 

Data analysis 

Since the stimulation frequencies for each trial were already known, it was easy to cal- 
culate the amplitudes of 6, 6,a and p frequency bands, as well as the SSVEP amplitude 
and SNR at the stimulation frequency by Fast Fourier Transform (FFT) using all the 
sampling points in each trial. The SNR was defined as the ratio of the amplitude at 
stimulation frequency to the mean value of the n adjacent points: 



where y was the amplitude spectrum calculated by FFT, / was the stimulation fre- 
quency, and y{f) was the SSVEP amplitude at stimulation frequency (refer to [27] for 
more details). When calculating the amplitudes of 6, 6, a and [3 frequency bands, the 
elicited SSVEP component at the stimulation frequency had been filtered from the cor- 
responding frequency band by a band-stop filter. The mean value of the amplitudes in 
the frequency band was selected as the index of this frequency band and used to calcu- 
late the ratio indices, such as 9/a and (9 + a)/p that were two widely used ratio indices 
in fatigue studies [24,28-30]. In total, four EEG indices (6, 6, a and p), two ratio indices 
(9/a and (9 -i- a)/|3), and two SSVEP indices (amplitude and SNR) in each trial along the 
experiments were obtained. The mean values of each index in the first five trials and 
the last five trials in the experiment were used to represent the corresponding index in 
the alert state and the fatigue state, respectively. The fatigue scores assessed by the fa- 
tigue questionnaire before and after the experiment were considered as the reference 
fatigue scores in the alert and fatigue states. One-way ANOVA with significance level 
of 0.05 was employed to test the significance of the difference between the alert state 
and the fatigue state for each index. 

Results 

Experiment 1: single stimulus 

First, the result of each individual was analyzed separately. Figure 1 shows the compari- 
son of the raw EEG signals and the spectrums of a participant between the alert and fa- 
tigue states in Experiment 1. Since the stimulation frequency was 15 Hz, the SSVEP 
components can be found at the fundamental frequency 15 Hz and the harmonic fre- 
quency 30 Hz in both alert and fatigue states. It is worth notice that the amplitude of 
SSVEP component at the fundamental frequency 15 Hz was decreased along the time 
elapsed. In Figure 1(b), it is difficult to distinguish two curves for the alert and fatigue 
states from the spectrums, despite some slight increases of the amplitude in 4-14 Hz 
frequency range that covered the 9 and a bands. In order to discover the difference be- 
tween the alert and fatigue states, different EEG indices were calculated. Figure 2 



SNR = 



n X yif) 



(1) 
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Figure 1 Comparison of Raw EEG signal and the spectrum of an individual participant between the 
alert and fatigue states for Experiment 1. Vertical axis for (a) and (b), amplitude {[N); horizontal axis for 
(a), time (sec); horizontal axis for (b), frequency (Hz); red curve: alert state; blue curve: fatigue state. 



presents the comparison of the fatigue scores from self-reported questionnaire and dif- 
ferent indices in the alert state and the fatigue state for this participant. The fatigue 
score by self-reported questionnaire was increased from 20 to 40, which suggests the 
increased fatigue level due to the experiment. The changes are obvious in the indices 6 
and a, as well as the ratio indices Q/a and (6 + a)/p resulting from the fatigue. In 
addition, Figure 2(h) and Figure 2(i) indicate the reduced amplitude and SNR of the 
elicited SSVEP in the fatigue state compared with the alert state. 

Besides the individual case study, an overall analysis on all participants was also per- 
formed. The self-reported fatigue questionnaire shows that in Experiment 1 the partici- 
pants' average fatigue level was significantly increased after the experiment. The fatigue 
score was significantly increased {F (1, 14) = 33.11, p < 0.001), with pre-mean score = 
21.50, standard deviation (SD) = 2.51; and post-mean score = 37.13, SD = 7.36. Figure 3 
demonstrates the comparison of the fatigue scores and indices in the alert state and the fa- 
tigue state. Four EEG indices 6, 9, a, P and the ratio index {Q + a)/^ show an increasing 
tendency, while the ratio index 6/a, SSVEP amplitude and SNR show an opposite ten- 
dency. The statistical test results of the indices are given in Table 1. Significant increases 
are found in 6 (f (1, 8) = 41.77, p < 0.001), 9 {F (1, 8) = 17.72 p < 0.001), a {F (1, 8) = 47.64, 
p < 0.001), and the ratio index (9 + a)/p (F (1, 8) = 66.40, p < 0.001), while significant de- 
creases are observed in the ratio index Q/a (F (1, 8) = 22.89, p < 0.001), as well as the 
SSVEP amplitude (F (1, 8) = 41.32,;? < 0.001) and SNR {F (1, 8) = 145.29, ;? < 0.001). The |3 
index (f (1, 8) = 2.59, p = 0.146) has no significant difference between the alert state and 
the fatigue state. Nevertheless, due to the individual differences, different sensitivities were 
found on the increasing fatigue level, so the changes of different indices could be different 
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Figure 2 Comparison of indices of an individual participant between the alert and fatigue states for 
Experiment 1. Comparison of the average values and SD of fatigue score, EEG indices, ratio indices, as well 
as SSVEP amplitude and SNR in the alert and fatigue states. Vertical axis for (b)-(i), amplitude (^iV); horizontal 
axis for (a)-(i), Alert: alert state. Fatigue: fatigue state. 



among participants. That is why the 6/a index was found increased in the individual case 
presented in Figure 2(f), while the group average was decreased as shown in Figure 3(f). 



Experiment 2: multi-stimulus with different frequencies 

In Experiment 2, as assessed by the self-reported fatigue questionnaire, the participants' 
average fatigue level was found significantly increased after the experiment: the fatigue 
score was significantly increased (f (1, 14) = 124.72, p < 0.001), with pre-mean score = 
21.17, SD = 1.75, and post-mean score = 37.50, SD = 8.34. Figure 4 demonstrates the com- 
parison of the fatigue scores and indices in the alert state and the fatigue state. The change 
trends are quite similar as the results obtained in Experiment 1: four EEG indices 6, 6, a, 
P and the ratio index (6 -i- a)/p exhibit an increasing tendency, while the ratio index 6/a, 
SSVEP amplitude and SNR show an opposite tendency. The statistical test results of the 
indices are given in Table 2. Significant increases are found in 6 {F (1, 8) = 8.70, p <0.05),a 
{F (1, 8) = 326.07, p < 0.001), |3 (f (1, 8) = 64.25, p < 0.001) and the ratio index (G + a)/|3 (f 
(1, 8) = 53.38, < 0.001), while significant decreases are found in the ratio index 6/a (F 
(1, 8) = 83.34, p < 0.001), as well as the SSVEP amplitude (F (1, 8) = 35.88, p < 0.001) 
and SNR (f (1, 8) = 35.40, p < 0.001). There is no significant difference in 6 (F (1, 8) = 
1.42, p = 0.267) between the alert state and the fatigue state. 
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Figure 3 Comparison of indices between the alert and fatigue states for Experiment 1. Comparison 
of the average values and SD of fatigue score, EEC indices, ratio indices, as well as SSVEP amplitude and 
SNR in tine alert and fatigue states. Vertical axis for (b)-(i), amplitude (|jV); horizontal axis for (a)-(i). 
Alert: alert state. Fatigue: fatigue state. 



Discussion 

Summary of evaluation results 
Experiment 1: single stimulus 

The users' fatigue level is found significantly increased after the experiment assessed by 
the fatigue questionnaire. The statistical test results demonstrate that the indices 6, 9 
and a have significant differences between the alert state and the fatigue state. These 
results suggest that the increases in 6, 6 and a are associated with the increasing fatigue 
level along the SSVEP experiments. For the ratio indices 6/a and (9 -i- a)/p, both of 
them show significant differences between the alert state and the fatigue state. There- 
fore, the decrease in 0/a and the increase in (0 + a)/p are associated with the increasing 
fatigue level. Moreover, the experiment results indicate that both the amplitude and the 
SNR of the elicited SSVEPs are significantly decreased by the increasing fatigue level. 

Experiment 2: multi-stimulus with different frequencies 

The users' fatigue level is significantly increased after the experiment assessed by the fa- 
tigue questionnaire. The statistical test results demonstrate that the indices 6, a and |3 
have significant differences between the alert state and the fatigue state. The increases in 
6, a and p are associated with the increasing fatigue level along the SSVEP experiments. 
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Table 1 Statistical test results for Experiment 1 


Index 


Alert 


Fatigue 




ANOVA 


Change 




Mean (SD) 


Mean (SD) 


F 


p 


direction 


6 


1.62 (0.05) 


1.77 (0.01) 


4] .77 


<0.001 


T 


e 


1.08 (0.02) 


1.18 (0.04) 


17.72 


<0.001 


t 


a 


1.15 (0.07) 


1 .39 (0.04) 


47.64 


<0.001 


T 


P 


0.73 (0.01) 


0.74 (0.01) 


2.59 


=0.146 




e/Q 


0.94 (0.05) 


0.84 (0.01) 


22.89 


<0.001 


i 


(9 + a)/p 


3.05 (0.10) 


3.48 (0.07) 


66.40 


<0.001 


T 


SSVEP amplitude 


3.48 (0.12) 


3.11 (0.03) 


44.32 


<0.001 


; 


SSVEP SNR 


2.22 (0.02) 


2.02 (0.03) 


145.29 


<0.001 


i 



Alert Mean: average value of the first five trials in the experiment; Fatigue Mean: average value of the last five trials in the 
experiment. SD: standard deviation; "1": increase; |: decrease; — : unchanged; degrees of freedom for the ANOVA = (1,8). 

Regarding the change of ratio indices G/a and (6 -i- a)/p, both of them show significant dif- 
ferences between the alert state and the fatigue state. Consistent with the results in Experi- 
ment 1, the decrease in 9/a and increase in (6 -i- a)/p are associated with the increasing 
fatigue level. Moreover, the experiment results show that the amplitude and the SNR of the 
elicited SSVEPs are significantiy decreased by the increasing fatigue level, which are also 
consistent with the results in Experiment 1. 



(a) Fatigue Score 



(b)5 



(c)e 




(d)a 



(e)P 



(f) e/a 




(g) (G-nayp (h) SSVEP Amplitude (i) SSVEP SNR 




Alert Fatigue Alert Fatigue Alert Fatigue 

Figure 4 Comparison of indices between the alert and fatigue states for Experiment 2. Comparison 
of the average values and SD of fatigue score, EEC indices, ratio indices, as well as SSVEP amplitude and SNR in 
the alert and fatigue states. Vertical axis for (b)-(l), amplitude (pV); horizontal axis for (a)-(l). Alert: alert state. 
Fatigue: fatigue state. 
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Table 2 Statistical test results for Experiment 2 


Index 


Alert 


Fatigue 




ANOVA 


Change 




Mean (SD) 


Mean (SD) 


F 


p 


direction 


6 


1.02 (0.03) 


1 .09 (0.04) 


8.70 


<0.05 


T 


e 


0.57 (0.02) 


0.59 (0.01) 


1.42 


=0.267 




a 


0.64 (0.01) 


0.70 (0.01) 


326.07 


<0.001 


T 


P 


0.34 (0.01) 


0.36 (0.01) 


64.25 


<0.001 


T 


e/Q 


1 .04 (0.02) 


0.97 (0.01) 


84.34 


<0.001 


i 


(9 + a)/p 


3.95 (0.05) 


4.21 (0.07) 


53.38 


<0.001 


T 


SSVEP amplitude 


1.56 (0.06) 


1 .39 (0.02) 


35.88 


<0.001 


; 


SSVEP SNR 


1.97 (0.03) 


1 .84 (0.04) 


35.40 


<0.001 


i 



Alert Mean: average value of the first five trials in the experiment; Fatigue Mean: average value of the last five trials in 
the experiment. SD: standard deviation; |: increase; |: decrease; — : unchanged; degrees of freedom for 
the ANOVA = (1,8). 



Feasibility and effectiveness of evaluation on fatigue by EEG spectral analysis 

It is found that most of the results are consistent in two elaborate SSVEP-based BCI 
experiments with two different groups of participants. The significant increases in 6 
and a are found associated with the increasing fatigue level in both experiments. For 
the 6 and (3 indices, even the results are not consistent in two experiments, it is stOl ob- 
served that they have the same trends. For the ratio index 6/a, because the change in a 
is more significant than the change in 9, the significant increase in 0/a is obtained and 
is associated with the increasing fatigue level in both experiments. For the ratio index 
(6 + a)/(3, the significant increase is found associated with the increasing fatigue level in 
both experiments. Since 9 and a have the same tendency while the change in [3 is 
smaller compared with the changes in 9 and a, (9 -i- a)/|3 amplifies the difference be- 
tween 9 and a, which is sensitive in evaluating the fatigue. Despite some variations due 
to different settings in the two paradigms and individual differences, significant results 
are found in both experiments with the a, 9/a and (9 -i- a)/|3 indices. This demonstrates 
that EEG spectral analysis can provide consistent objective evaluation of the fatigue in 
SSVEP-based BCIs. 

Moreover, it is found that the amplitude and the SNR of the elicited SSVEPs are sig- 
nificantly affected by the increasing fatigue level. The results support that the ampli- 
tude and SNR of the elicited SSVEPs are easily affected by mental states, fatigue, and 
degree of attention level. As significant mental effort is required to elicit SSVEP with 
high amplitude and SNR, the participants get fatigue easily. The decrement of arousal 
and the loss of attention caused by significant mental effort and repetitive stimulation 
will reduce the quality of the elicited SSVEPs. It is more difficult to elicit good quality 
SSVEPs in the fatigue state even the participants are still focusing on the targets. Fur- 
thermore, the decreases of the amplitude and the SNR of the elicited SSVEPs conse- 
quently deteriorate the discrimination accuracy, detection speed, ITR and overall 
performance of the BCI systems. 

Physiological explanation 

Some studies showed that the 6 wave is significantly increased when participants are get- 
ting fatigue [31,32]. The 6 wave is the lowest brain activity which is usually associated with 
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deep stages of sleep, and it is also a pathological slow wave and associated with a wide 
array of disorders [33]. When a participant is getting fatigue, the drowsiness and de- 
crease arousal level will elevate slow wave brain activities. However, the 6 wave is 
easily influenced by artifacts which usually invade low EEG frequencies. In addition, 
all the participants in the experiments are in awake state and do not have any type of 
disorders. Therefore, it is not sure the significant increase in S is associated with in- 
creasing fatigue level. 

The increased 9 wave was found associated with increasing fatigue level in many 
previous fatigue monitoring studies [5,31,32,34,35]. The 6 wave is related to sleep, 
work memory, cognitive performance and a variety of mental states [22,33]. In- 
creased 6 activity has been proven associated with generalized performance decre- 
ments, including working memory, information encoding and so forth [22]. When a 
user is getting fatigue along the experiment, the user will feel drowsy and tired with 
the capacity degraded due to the loss of attention and decrease of arousal. 

The results in a wave were consistent with the existing studies showing that the 
significant increase in a activity is associated with the increasing fatigue level 
[5,24,31,34,35]. The a wave appears in the relaxed and effortless alertness mental 
state, and gives a relevant indication about the occurrence of a state of relaxation or 
of low arousal [33,34]. The increased a activity is associated with an increased men- 
tal effort to maintain vigilance level [22]. When participants are getting fatigue, their 
attention, concentration and vigilance level will decrease. Therefore, the participants 
need to put more attention and increase mental effort to focus on the target and 
maintain the vigilance level in the fatigue state compared with the alert state. 

The increased |5 wave is associated with increasing alertness, arousal and excite- 
ment [33]. In this study, the p activity shows an increasing trend over time. Previous 
studies about the association between p wave and fatigue are quite variable: the |3 ac- 
tivity had been found altered in [36] with the increasing fatigue level, other studies 
reported significant increases in p wave [5] and decreases in |3 [24] associated with 
increasing fatigue level, but no significant change in p according to other two litera- 
tures [32,37]. 

Similar results were also obtained in other fatigue studies with the ratio index (9 + a)/p. 
In [24], (9 + a)/p index showed a significant increase associated with the increasing fatigue 
level, and also related to the mental alertness level. However, no significant change 
was observed in 9/a in this research. A big increase was found in (9 -t- a)/p at the end 
of task in [28]. The 9 and a activities are already proved to be associated with the fa- 
tigue, while the relation between p wave and the fatigue are quite variable. In this 
study, the change in 9 and a are more significant than the change in p, the ratio index 
(9 + a)/p thus amplifies the mutual addition effects from 9 and a. Moreover, increased 
9 activity is found associated with the decreased generalized performance and arousal 
level, and the increased a band is associated with an increased mental effort to main- 
tain vigilance level. Therefore, the decrease of 9/a indicates that the user is putting 
more attention and mental effect to focus on the target and fight against the increasing 
fatigue level. In this study, two widely used ratio indices 9/a and (9 + a)/p are adopted 
to measure the fatigue, as this is helpful to the comparison of the findings with the re- 
sults in the literature of fatigue research. Other choices on the indices are possible and 
deserve further study. 
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Conclusions 

In this paper, an objective approach based on EEG spectral analysis is proposed to evalu- 
ate the fatigue in SSVEP-based BCIs. In order to prove the feasibility and effectiveness of 
the proposed method, two elaborate SSVEP-based BCI experiments are designed and 
tested with two different groups of participants. Consistent experiment results indicate 
that the significant increases in a and (6 -i- a)/p, as well as the decrease in Q/a are associ- 
ated with the increasing fatigue level. In addition, the experiment results also show that 
the amplitude and SNR of the elicited SSVEPs are significantly affected by users' fatigue in 
the SSVEP-based BCI experiments. The proposed approach would be promising in pro- 
viding an objective, quantitative and real-time measure of the fatigue in SSVEP-based 
BCIs. With such a measure a systematic study on the factors such as stimulus frequency, 
color and duty cycle, as well as their influences on fatigue in SSVEP-based BCIs could be 
performed, which would be helpful in understanding the fatigue problem and eventually 
the design of optimal SSVEP-based BCIs with the fatigue alleviated. 

Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

FW and TC initiated the idea and conceived the study. TC, CMW and JNC designed and conducted experiments. TC 
performed data analysis, and drafted the manuscript. FW and YH supervised, revised and gave the final approval of 
the manuscript. All authors read and approved the final manuscript. 

Acl<nowledgements 

This work is supported in part by the Macau Science and Technology Development Fund under grant FDCT 036/2009/ 
A and the University of Macau Research Committee under grants IVIYRGI 39(Y1 -L2)-FST1 1 -WF, MYRG079(Y1 -L2)-FST1 2- 
VIVll, MYRG069(Y1-L2)-FST13-WF and IV1YRG201 4-001 74-FST 

Author details 

'Department of Electrical and Computer Fngineering, University of Macau, Macau, China. ^Department of Orthopaedics 
and Traumatology, The University of Hong Kong, Pokfulam, Hong Kong, China. 

Received: 17 December 2013 Accepted: 5 March 2014 
Published: 12 March 2014 

References 

1. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM: Brain-computer interfaces for 
communication and control. Clin Neuropliysiol 2002, 113:767-791. 

2. Wang Y, Gao X, Hong B, Jia C, Gao S: Brain-computer interfaces based on visual evoked potentials: feasibility 
of practical system designs. IEEE Eng Med Biol Mag 2008, H-hA-l\. 

3. Shen J, Barbera J, Shapiro CM: Distinguishing sleepiness and fatigue: focus on definition and measurement. 
Sleep Med Rev 2006, 10:63-76. 

4. Craig A, Tran Y, Wijesuriya N, Boord P: A controlled investigation into the psychological determinants of 
fatigue. Biol Psychol 2006, 72:78-87. 

5. Craig A, Tran Y, Wijesuriya N, Nguyen H: Regional brain wave activity changes associated with fatigue. 
Psychophysiology 2012, 49:574-582. 

6. Van-Gerven M, Farquhar J, Schaefer R, VIek R, Geuze J, Nijholt A, Ramsey N, Haselager P, VuurpijI L, Gielen S, 
Desain P: The brain-computer interface cycle. J Neural Eng 2009, 6:041 001 . 

7. Pinheiro CG, Naves FL, Pino P, Losson F, Andrade AO, Bourhis G: Alternative communication systems for people 
with severe motor disabilities: a survey. BloMed Eng Online 201 1 , 1 0:31 . 

8. Muller MM, Hillyard S: Concurrent recording of steady-state and transient event-related potentials as indices 
of visual-spatial selective attention. Clin Neumphyslol 2000, 111:1 544-1 552. 

9. Toffanin P, De-Jong R, Johnson A, Martens S: Using frequency tagging to quantify attentional deployment in a 
visual divided attention task. Int J Psychophysioi 2009, 72:289-298. 

10. Shyu K, Lee P, Liu Y, Sie J: Dual-frequency steady-state visual evoked potential for brain computer interface. 
Neurosci Lett 2010, 483:28-31. 

11. Lee P, Sie J, Liu Y, Wu C, Lee M, Shu C, Li P, Sun C, Shyu K; An SSVEP-actuated brain computer interface using 
phase-tagged flickering sequences: a cursor system. Ann Blamed Eng 2010, 38:2383-2397. 

12. Muller-Putz GR, Pfurtscheller G: Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Trans Biomed 
Eng 2008, 55:361-364 

13. Lopez-Gordo MA, Prieto A, Pelayo F, Morillas C: Customized stimulation enhances performance of independent 
binary SSVEP-BCIs. Clin Neuropiiyslol 2011, 122:128-133. 

14. Diez PF, Mut VA, Perona EMA, Leber EL: Asynchronous BCI control using high-frequency SSVEP. J Neuroeng 

Reiiabll 20U, 8:39. 



Cao et al. BioMedical Engineering OnLine 2014, 13:28 
http://www.biomedical-engineering-online.eom/content/13/1/28 



Page 1 3 of 1 3 



15. Volosyak I, Valbuena D, Luth T, Malechka T, Graser A: BCI demographics II: how many (and what kind of) people 
can use a high-frequency SSVEP BCI? iEEE Tram Neural Syst Rehabil Eng 201 1, 19:232-239. 

16. Lee P, Yeh C, Cheng J, Yang C, Lan G: An SSVEP-based BCI using high duty-cycle visual flicker. IEEE Trans 
Blomed Eng 201 1, 58:3350-3359. 

17. Chang M, Baek H, Lee S, Park K: An amplitude-modulated visual stimulation for reducing eye fatigue in 
SSVEP-based brain-computer interfaces. Clin Neurophysiol, in press. 

18. Allison B, Luth T, Valbunena D, Teymourian A, Volosyak I, Graser A: BCI demographics: how many (and what kind of) 
people can use an SSVEP BCI? IEEE Trans Neural Syst Rehabil Eng 201 0, 1 8:1 07-1 1 6. 

19. Bieger J, Molia GG: Light stimulation properties to influence brain activity: a brain-computer interface 
application. Philips Research Technical Note 2010, TN-201 0-003 15. 

20. Allison BZ, Brunner C, Altstatter C, Wagner IC, Grissmann S, Neuper C: A hybrid ERD/SSVEP BCI for continuous 
simultaneous two dimensional cursor control. J Neurosci Methods 2012, 209:299-307. 

21. Johns MW: A sleep physiologist' s view of the drowsy driver. Psychol Behav 2000, 3:241-249. 

22. Klimesch W: EEG alpha and theta oscillations reflect cognitive and memory performance: a review and 
analysis. Brain Res Rev 1999, 29:169-195. 

23. Lafrance C, Dumont M: Diurnal variations in the waking EEG: comparisons with sleep latencies and subjective 
alertness. J Sleep Res 2000, 9:243-248. 

24. Eoh HJ, Chung MK, Kim S: Electroencephalographic study of drowsiness in simulated driving with sleep 
deprivation. Int J Ind Ergonom 2005, 35:307-320. 

25. Cao T, Wong CM, Wan F, Hu Y: Objective indication of fatigue in SSVEP-based BCI through EEG spectral analysis. In 
Proceeding of the Fifth International Brain-Computer Interface Meeting: 3-7 June 201 3: Pacific Grove. California, USA Edited 
by Millan JR, Gao 5, Muller-Putz GR, Wolpaw JR Muggins JE. Verlag der Technischen Universitat Graz; 2013:9. 

26. Cella M, Chalder T: Measuring fatigue in clinical and community settings. J Psychosom Res 2010, 69:17-22. 

27. Wang Y, Wang R, Gao X, Hong B: A practical VEP-based brain-computer interface. IEEE Trans Neural Syst Rehabil 
Eng 2006, 14:234-240. 

28. Japa BT, Lala 5, Fischerb P, Bekiaris E: Using EEG spectral components to assess algorithms for detecting 
fatigue. Expert Syst Appi 2009, 36:2352-2359. 

29. Cajochen C, Brunner DP, Krauchi K, Graw P, Wirz-Justice A: Power density in theta/alpha frequencies of the wak- 
ing EEG progressively increases during sustained wakefulness. Sleep 1995, 18:890-894. 

30. Cajochen C, Krauchi K, Arx MV, Mori M, Graw P, Wirz-Justice A: Daytime melatonin administration enhances 
sleepiness and theta/alpha activity in the waking EEG. Neurosci Lett 1996, 207:209-213. 

31. Lai SKL, Craig A: Driver fatigue: electroencephalography and psychological assessment. Psychophysiology 2002, 
39:313-321. 

32. Caldwell JA, Hall KK, Erickson BS: EEG data collected from helicopter pilots in flight are sufficiently sensitive to 
detect increased fatigue from sleep deprivation. Int J Aviat Psychol 2002, 12:19-32. 

33. Steriade M, Gloor P, Llinas RR, Da-Silva FHL, Mesulam MM: Basic mechanisms of cerebral rhythmic activities. 
Clin Neurophysiol 1990, 76:481-508. 

34. Campagne A, Pebayle T, Muzet A: Correlation between driving errors and vigilance level: influence of the 
driver's age. Physiol Behav 2004 80:515-524. 

35. Trejo LJ, Knuth K Prado P, Rosipal R, Kubitz K Kochavi R, Matthews B, Zhang Y EEG-based estimation of 
cognitive fatigue: convergent evidence for three-state model. Lect Notes Comput Sc 2007, 4565:201 -211. 

36 Wierwille WW, Ellsworth LA: Evaluation of driver drowsiness by trained raters. Acdd/lnfl/ Prev 1994, 26:5715-5781. 
37. Tanaka H, Hayashi M, Hori T: Topographical characteristics and principal component structure of the 
hypnagogic EEG. Sleep 1997, 20:523-534 



doi:1 0.1 1 86/1 475-925X-1 3-28 

Cite this article as: Cao ef al: Objective evaluation of fatigue by EEG spectral analysis in steady-state visual 
evoked potential-based brain-computer interfaces. BioMedical Engineering OnLine 2014 13:28. 



Submit your next manuscript to BiolVled Central 
and tal<e full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at \ rai-vtral 

www.biomedcentral.com/submit \J Biomea central 



